Apparatus for displaying vehicle information in augmented reality

ABSTRACT

An information display apparatus may include a processor configured to display a display object in augmented reality; and a storage configured to store data and algorithms driven by the processor, wherein the processor determines a position of the display object by use of at least one of a total number of lanes or a number of lanes in a road in a driving direction of a host vehicle, possible traveling direction information for each lane, and driving direction information related to the host vehicle, and the information display apparatus is disposed within a vehicle or outside the vehicle, and when disposed outside the vehicle, is configured to transmit display information related to the display object to the vehicle or a mobile device.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority to Korean Patent Application No.10-2020-0119045, filed on Sep. 16, 2020, the entire contents of which isincorporated herein for all purposes by this reference.

BACKGROUND OF THE PRESENT INVENTION Field of the Invention

The present invention relates to an information display apparatus basedon augmented reality, and more particularly, to a technique forsupplementing a reference position and displaying additional informationbased on augmented reality.

Description of Related Art

In general, vehicles (means of transportation) have become essentialproducts in a modern society as their mobility and usability areimproved by applying advanced technique., and recently, a head-updisplay (HUD) has been used to project information onto driver's eyes.

The head-up display is a front display device designed to displaydriving information related to a means of transportation on front glassof the means of transportation. That is, a head-up display unit isdisplayed by forming a virtual image such that a driver can recognizevarious types of information, such as a speed, a fuel level, atemperature, and a warning direction displayed on a vehicle cluster, onwindshield glass.

Furthermore, a navigation system is mounted on a recent means oftransportation to provide a destination and directions to a driver, andfurthermore, in the navigation system to which augmented reality isapplied, specific information may be displayed in a form of augmentedreality. However, accuracy and diversity of information provided by useof augmented reality in the navigation system is poor.

The information included in this Background of the Invention section isonly for enhancement of understanding of the general background of theinvention and may not be taken as an acknowledgement or any form ofsuggestion that this information forms the prior art already known to aperson skilled in the art.

BRIEF SUMMARY

Various aspects of the present invention are directed to providing aninformation display apparatus based on augmented reality configured fordisplaying vehicle information in an augmented reality form by selectingan accurate position in an environment where a precise map or precisepositioning is not available.

Furthermore, of the present invention an exemplary embodiment of thepresent invention is directed to providing an information displayapparatus based on augmented reality configured for providing a userwith additional information which is mapped with the real world based onaugmented reality.

The technical objects of the present invention are not limited to theobjects mentioned above, and other technical objects not mentioned maybe clearly understood by those skilled in the art from the descriptionof the claims.

Various aspects of the present invention are directed to providing aninformation display apparatus, including: a processor configured todisplay a display object in augmented reality; and a storage configuredto store data and algorithms driven by the processor, wherein theprocessor determines a position of the display object by use of at leastone of a total number of lanes or a number of lanes in a road in adriving direction of a host vehicle, possible traveling directioninformation for each lane, and driving direction information related tothe host vehicle, and the information display apparatus is disposedwithin a vehicle or outside the vehicle, and when disposed outside thevehicle, is configured to transmit display information related to thedisplay object to the vehicle or a mobile device.

In various exemplary embodiments of the present invention, the processormay determine the position of the display object by moving a referenceposition on a general map from a lane on which the host vehicle istraveling to a lane corresponding to the driving direction of the hostvehicle by use of the possible traveling direction information for eachlane.

In various exemplary embodiments of the present invention, the processormay display the display object in a lane having a same driving directionas the driving direction of the host vehicle, and does not display thedisplay object in a lane having a direction opposite to the drivingdirection of the host vehicle.

In various exemplary embodiments of the present invention, the processormay determine a moving distance based on the total number of lanes inthe case of a road in which there is no distinction between directionsof going up and down on a map, and may determine a moving distance byuse of at least one of the total number of lanes in the drivingdirection thereof, the number of lanes in the driving direction thereof,and the number of lanes in a direction opposite to the driving directionthereof, and determines the position of the display object by moving thereference position on the general map by the moving distance in the caseof a road in which there is distinction between directions of going upand down on the map.

In various exemplary embodiments of the present invention, the processormay determine a moving distance according to the total number of lanesand lane widths in the case of a road in which there is no distinctionbetween directions of going up and down on a map, and may determine amoving distance by use of the lane widths and at least one of the totalnumber of lanes in the driving direction thereof, the number of lanes inthe driving direction thereof, and the number of lanes in a directionopposite to the driving direction thereof, and determines the positionof the display object by moving the reference position on the generalmap by the moving distance in the case of a road in which there isdistinction between directions of going up and down on the map.

In various exemplary embodiments of the present invention, the processormay determine a moving direction of the reference position inconsideration of a vehicle driving direction for each country.

In various exemplary embodiments of the present invention, the processormay estimate a width of another lane by use of a lane width of a lane onwhich the host vehicle is currently traveling, or may determine widthsof at least one lane in the driving direction of the host vehicle on aroad on which the host vehicle is traveling, and then estimates anaverage value of the measured widths of the at least one lane as theeach lane width.

In various exemplary embodiments of the present invention, the processormay determine the moving distance of the reference position bydetermining the lane width as a predetermined value and using the numberof lanes and the lane widths when unable to estimate a lane width of alane on which the host vehicle is traveling.

In various exemplary embodiments of the present invention, the processormay determine an average value of the lane width by use of remaininglane widths excluding a lane width which is outside a predeterminedreference range when a measured value of each lane is outside thereference range after measuring the widths of the at least one lane.

Various aspects of the present invention are directed to providing aninformation display apparatus, including: a processor configured todisplay an eco state of a vehicle based on augmented reality; and astorage configured to store data and algorithms driven by the processor,wherein the processor is configured to classify and display displayobjects depending on the eco state, and the information displayapparatus is disposed within a vehicle or outside the vehicle, and whendisposed outside the vehicle, is configured to transmit displayinformation related to the eco state to the vehicle or a mobile device.

In various exemplary embodiments of the present invention, the processormay classify and display at least one of color, shape, type, and size ofthe display objects depending on the eco state.

In various exemplary embodiments of the present invention, the processormay determine the eco state by comparing fuel efficiency of othervehicles and fuel efficiency of the host vehicle based on a same vehiclemodel or a same condition as the host vehicle.

In various exemplary embodiments of the present invention, the anothervehicle may include at least one of all vehicles within a certain radiusor satisfying a certain condition, all vehicles in a same country basedon a same vehicle type, and vehicles designated with consent of a user.

In various exemplary embodiments of the present invention, the processormay determine the eco state depending on a battery usage state of thevehicle.

Various aspects of the present invention are directed to providing aninformation display apparatus, including: a processor configured todisplay regional boundary information based on augmented reality; and astorage configured to store data and algorithms driven by the processor,wherein the processor is configured to display an object representing aregional boundary, upon determining that the regional boundaryinformation exists, and the information display apparatus is disposedwithin a vehicle or outside the vehicle, and when disposed outside thevehicle, is configured to transmit display information related to theregional boundary information to the vehicle or a mobile device.

In various exemplary embodiments of the present invention, the regionalboundary information may include at least one of information related toan area where the host vehicle is currently positioned or informationrelated to a new area which the vehicle newly enters.

In various exemplary embodiments of the present invention, the objectrepresenting the regional boundary information may include at least oneof a national flag, a country name, a national bird, a national flower,a regional symbol, a region name, and a byword.

In various exemplary embodiments of the present invention, the processormay display the object representing the regional boundary thereof withina predetermined distance before or after passing through the regionalboundary thereof.

Various aspects of the present invention are directed to providing aninformation display apparatus, including: a processor configured todisplay a display object in augmented reality; and a storage configuredto store data and algorithms driven by the processor, wherein theprocessor provides at least one display method for displaying thedisplay object to a user, and receives the at least one display methodselected by the user to apply the at least one display method, and theinformation display apparatus is disposed within a vehicle or outsidethe vehicle, and when disposed outside the vehicle, is configured totransmit the display method inputted from the user to the vehicle or amobile device.

In various exemplary embodiments of the present invention, the processormay receive selection of whether to display each function of functionsprovided by the augmented reality, which is made by the user, to applyeach function.

The present technique may minimize the sense of heterogeneity byaccurately determining and displaying an object display position whendisplaying vehicle information based on augmented reality.

Furthermore, the present technique may increase user convenience byproviding information related to an area that could not be previouslydisplayed and additional information which is matched with the realworld based on augmented reality to the user.

Furthermore, various effects which may be directly or indirectlyidentified through the present document may be provided.

The methods and apparatuses of the present invention have other featuresand advantages which will be apparent from or are set forth in moredetail in the accompanying drawings, which are incorporated herein, andthe following Detailed Description, which together serve to explaincertain principles of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A illustrates a block diagram showing a configuration of aninformation display apparatus based on augmented reality according tovarious exemplary embodiments of the present invention.

FIG. 1B illustrates a block diagram showing a configuration of aninformation display device based on augmented reality according tovarious exemplary embodiments of the present invention.

FIG. 2 illustrates a view for describing reference position supplementbased on augmented reality according to various exemplary embodiments ofthe present invention.

FIG. 3A, FIG. 3B and FIG. 3C illustrate an example of differentlydisplaying a color of a carpet depending on a vehicle state based onaugmented reality according to various exemplary embodiments of thepresent invention.

FIG. 4 illustrates an example of displaying a color of a carpet in astepwise manner depending on a vehicle state based on augmented realityaccording to various exemplary embodiments of the present invention.

FIG. 5A, FIG. 5B and FIG. 5C illustrate an example of displayingregional boundary information based on augmented reality according tovarious exemplary embodiments of the present invention.

It may be understood that the appended drawings are not necessarily toscale, presenting a somewhat simplified representation of variousfeatures illustrative of the basic principles of the present invention.The specific design features of the present invention as includedherein, including, for example, specific dimensions, orientations,locations, and shapes will be determined in part by the particularlyintended application and use environment.

In the figures, reference numbers refer to the same or equivalentportions of the present invention throughout the several figures of thedrawing.

DETAILED DESCRIPTION

Reference will now be made in detail to various embodiments of thepresent invention(s), examples of which are illustrated in theaccompanying drawings and described below. While the presentinvention(s) will be described in conjunction with exemplary embodimentsof the present invention, it will be understood that the presentdescription is not intended to limit the present invention(s) to thoseexemplary embodiments. On the other hand, the present invention(s)is/are intended to cover not only the exemplary embodiments of thepresent invention, but also various alternatives, modifications,equivalents and other embodiments, which may be included within thespirit and scope of the present invention as defined by the appendedclaims.

Hereinafter, some exemplary embodiments of the present invention will bedescribed in detail with reference to exemplary drawings. It may benoted that in adding reference numerals to constituent elements of eachdrawing, the same constituent elements have the same reference numeralsas possible even though they are indicated on different drawings.Furthermore, in describing exemplary embodiments of the presentinvention, when it is determined that detailed descriptions of relatedwell-known configurations or functions interfere with understanding ofthe exemplary embodiments of the present invention, the detaileddescriptions thereof will be omitted.

In describing constituent elements according to various exemplaryembodiments of the present invention, terms such as first, second, A, B,(a), and (b) may be used. These terms are only for distinguishing theconstituent elements from other constituent elements, and the nature,sequences, or orders of the constituent elements are not limited by theterms. Furthermore, all terms used herein including technical scientificterms have the same meanings as those which are generally understood bythose skilled in the Field of the Invention to which various exemplaryembodiments of the present invention pertains (those skilled in the art)unless they are differently defined. Terms defined in a generally useddictionary shall be construed to have meanings matching those in thecontext of a related art, and shall not be construed to have idealizedor excessively formal meanings unless they are clearly defined in theexemplary embodiment of the present invention.

Hereinafter, various exemplary embodiments of the present invention willbe described in detail with reference to FIG. 1A to FIG. 5C.

FIG. 1A illustrates a block diagram showing a configuration of aninformation display apparatus according to various exemplary embodimentsof the present invention.

The information display apparatus of the present invention may beapplied to all means of transportation, and the means of transportationmay include a four-wheeled means of transportation, such as a vehicle ora truck, a two-wheeled means such as a motorcycle or a bicycle, and allmovable means such as an aircraft or a ship, the information displayapparatus may display information such as a destination, a stopoverarea, a point of interest (POI), and a driving state of a means oftransportation, and may be implemented as a navigation system, an audiovideo navigation (AVN), or the like.

Referring to FIG. 1A, according to various exemplary embodiments of thepresent invention, the display information apparatus 100 may beimplemented inside the means of transportation. In the instant case, theinformation display apparatus 100 may be integrally formed with internalcontrol units of the means of transportation, and may be implemented asa separate device to be connected to the control units of the means oftransportation by a separate connecting means. Furthermore, theinformation display apparatus 100 may be configured in a form of aserver 400 outside the means of transportation as illustrated in FIG.1B, and outside the means of transportation, the server 400 transmitsdriving information to the in-vehicle display or a mobile device 500 todisplay it based on augmented reality. That is, the server 400 mayreceive vehicle control information (collision warning information orinter-vehicle distance control information, etc.) in connection with anin-vehicle forward collision warning (FCW) system, a smart cruisecontrol (SCC) system, and the like, to transmit vehicle informationcorresponding thereto to the in-vehicle information display apparatus100. In the instant case, the mobile device 500 may include all mobilecommunication terminals having a display device, such as a smart phone,a personal digital assistant (PDA), a portable multimedia player (PMP),a digital camera, a portable game machine, an MP3 player, a smart key, atablet PC, as a user terminal. When driving information is transmittedfrom an outside of the vehicle to the means of transportation, it may betransmitted from a device or a server outside the vehicle to anin-vehicle device, and the in-vehicle device may include, e.g., acluster, a head-up display, a navigation terminal, an audio, a video, anavigation (AVN), and the like.

Furthermore, the information display apparatus 100 in various exemplaryembodiments of the present invention may be applied to autonomousdriving control vehicles, such as advanced driver assistance systems(ADAS), smart cruise control (SCC) systems, and forward collisionwarning (FCW) systems, and may display information which is receivedthrough transmission/reception with respect to the ADAS, the SCCsystems, the FCW systems, or the like, based on augmented reality.

According to the exemplary embodiment of the present invention, theinformation display apparatus 100 which is operated as the above may beimplemented in a form of an independent hardware device including amemory and a processor that processes each operation, and may be drivenin a form included in other hardware devices such as a microprocessor ora general purpose computer system.

Referring to FIG. 1A, the information display apparatus 100 of the meansof transportation may include a communication device 110, a storage 120,and a processor 130, and a display device 140.

The communication device 110, which is a hardware device implementedwith various electronic circuits to transmit and receive signals througha wireless or wired connection, may perform V2I communication by use ofan in-vehicle network communication technique or a wireless Internetaccess or short range communication technique with servers,infrastructure, and other vehicles outside the vehicle in variousexemplary embodiments of the present invention. Herein, in-vehiclecommunication may be performed through controller area network (CAN)communication, local interconnect network (LIN) communication, orflex-ray communication as the in-vehicle network communicationtechnique. Furthermore, the wireless communication technique may includewireless LAN (WLAN), wireless broadband (Wibro), Wi-Fi, WorldwideInteroperability for Microwave Access (WiMAX), etc. Furthermore,short-range communication technique may include Bluetooth, ZigBee, ultrawideband (UWB), radio frequency identification (RFID), infrared dataassociation (IrDA), and the like.

As an example, the communication device 110 may receive trafficinformation, road information, vehicle information for display based onaugmented reality, and the like from an external server 400. As anexample, vehicle information for display based on augmented reality mayinclude corrected reference position information, vehicle eco stateinformation, regional boundary information, augmented reality functionor method information selected by a user, and the like.

The storage 120 may store information received by the communicationdevice 110, data obtained by the processor 130, data and/or algorithmsrequired for the processor 130 to operate, and the like. As an example,the storage 120 may store corrected reference position information,vehicle eco state information, regional boundary information, augmentedreality function or method information selected by a user, and the like.

The storage 120 may include a storage medium of at least one type amongmemories of types such as a flash memory, a hard disk, a micro, a card(e.g., a secure digital (SD) card or an extreme digital (XD) card), arandom access memory (RAM), a static RAM (SRAM), a read-only memory(ROM), a programmable ROM (PROM), an electrically erasable PROM(EEPROM), a magnetic memory (MRAM), a magnetic disk, and an opticaldisk.

The processor 130 may be electrically connected to the communicationdevice 110, the storage 120, and the like, may electrically control eachcomponent, and may be an electrical circuit that executes softwarecommands, performing various data processing and calculations describedbelow. The processor 130 may be, e.g., an electronic control unit (ECU),a micro controller unit (MCU), or other subcontrollers mounted in themeans of transportation.

When a display object is displayed based on augmented reality, theprocessor 130 may determine a position of the display object bycorrecting a reference position on a general map by use of at least oneof a total number of lanes or a number of lanes in a road in a drivingdirection of a host vehicle, direction information for each lane,driving direction information related to the host vehicle.

Furthermore, when passing through a region (or country) while driving,the processor 130 may display regional boundary information based onaugmented reality.

The processor 130 may determine an eco state of the vehicle and displaythe eco state of the vehicle based on the augmented reality.

The processor 130 may provide at least one display method for displayinga display object to a user, and may select and apply the at least onedisplay method from the user.

A navigation system such as a navigation may use a precise map orprecise positioning to determine a current position, but may determine aposition of a display object and display it based on augmented realityby use of a general navigation map or general navigation positioninginstead of the precise map or the precise positioning due to limitationsin cost or technique.

Accordingly, since the display position of the object is incorrect,accuracy of augmented reality display information may decrease andusability thereof may decrease, and thus when the vehicle information isdisplayed in augmented reality, the processor 130 in various exemplaryembodiments of the present invention selects the position of the objectbased on the total number of lanes of the object, the number of lanesfor the driving direction thereof, possible traveling directioninformation for each lane using lane guidance information, and whetherthere is a lane having a same direction as a driving direction of thehost vehicle, and makes it possible to accurately display the positionof the display object by determining the driving direction thereof. Inthe instant case, the display object includes objects for display suchas a host vehicle, a vehicle ahead, a target vehicle, a dynamic wall,and an obstacle.

First, the processor 130 may select a display position by determining amoving distance of the display object based on the total number of lanesor the number of lanes in the driving direction thereof. In many cases,a reference position on a map for displaying the display object is acenter line of the road in an environment where a precise map is notprovided or precise positioning is not available, that is, in anenvironment where a general map or general positioning may be used.

Accordingly, in an environment where a precise map is not provided orprecise positioning is not available, the processor 130 may select anaccurate display position by determining a moving distance forcorrecting the reference position in consideration of the total numberof lanes or the number of lanes for the driving direction thereof, andmay display the display object (e.g., dynamic wall) based on acorresponding display position.

To the present end, the processor 130 may determine a moving distanceand a moving direction for moving the reference position to correct thereference position.

First, the processor 130 may determine that a current driving road is atwo-way road when both forward and backward values in link trafficinformation related to a current driving road are open.

In the case of a road in which there is no distinction between going upand down on a map, the processor 130 determines the moving distancebased on the total number of lanes, while in the case of a road in whichthere is a distinction between going up and down on a map, the processor130 may determine a moving distance by use of at least one of the totalnumber of lanes in the driving direction, the number of lanes in thedriving direction, and the number of lanes in an opposite direction, andmay determine a position of the display object by moving the referenceposition on the general map by the moving distance.

Furthermore, in the case of the road in which there is no distinctionbetween going up and down on the map, the processor 130 determines themoving distance based on the total number and width of lanes, while inthe case of a road in which there is no distinction between going up anddown on a map, the processor 130 may determine a moving distance by useof the width of lanes and at least one of the total number of lanes inthe driving direction, the number of lanes in the driving direction, andthe number of lanes in an opposite direction, and may determine aposition of the display object by moving the reference position on thegeneral map by the moving distance.

When the current driving road has no distinction between going up anddown, the processor 130 may determine a moving distance for moving fromthe reference position on a map based on a width of lanes and apredetermined number of lanes (e.g., ½ of the total number of lanes)compared to the total number of lanes in consideration of the totalnumber of lanes. That is, the processor 130 may determine a movingdistance for moving the reference position as shown in Equation 1 in thecase of a road in which there is no distinction between going up anddown.Moving distance=total lanes/4*lane width  (Equation 1)

In the instant case, the total number of lanes indicates a number oflanes of an entry link at an intersection, and the lane width may beestimated by measuring a lane width of the host vehicle or may be set toa predetermined value. A method for estimating the lane width will bedescribed later in detail.

For example, when the number of lanes on a road in which there is nodistinction between going up and down is four, the processor 130 maydetermine the moving distance by multiplying the second lane, which ishalf of the fourth lane, and the lane width per lane. For example, whenthe lane width is 2.7 m, the moving distance is obtained as 5. 2M bymultiplying it by 2. Accordingly, the processor 130 may move thereference position on the map by 2.7 m.

On the other hand, the processor 130 may determine the moving distanceby use of the lane width and at least one of the total number of lanes,the number of lanes in the driving direction, and the number of lanes ina direction opposite to the driving direction in the case of a road inwhich there is a distinction between going up and down on the map. Theprocessor 130 may determine the moving distance by use of Equation 2 inthe case of the road in which there is a distinction between going upand down on the map.Moving distance=(total number of lanes−number of lanes in drivingdirection+number of pocket lanes)/2*lane width  (Equation 2)

In the instant case, the total number of lanes and the number of lanesin the driving direction are a number of lanes of the entry link at theintersection.

For example, when the total number of lanes is 6 lanes and the number ofpocket lanes is 2, the reference position depending on the general mapis provided at a center line, 3 lanes, which are the number of lanes inthe driving direction of the host vehicle, are subtracted from the 6lanes, and the 2 pocket lanes add up to become 5, and the referenceposition may be selected as the position of the display object by movingthe reference position by a value obtained by multiplying the 2.5 lanes,which is ½ of 5, by the lane width.

For example, when 4 of 8 round-trip lanes that are currently driving arein the driving direction and the lane width is 3 meters, a point wherethe reference position is moved by 6 meters may be selected as theposition of the display object by multiplying 2 lanes, which are half ofthe four lanes, which are the number of driving lanes relative to thetotal number of lanes on the map, by 3, which is the width of each lane.

The present invention includes an example of determining the movingdistance by multiplying the determined number of lanes by the lanewidth, but the present invention is not limited thereto.

FIG. 2 illustrates a view for describing reference position supplementbased on augmented reality according to various exemplary embodiments ofthe present invention.

Referring to FIG. 2 , when a reference position on a general map ispositioned at a road center line 201 to display a dynamic wall 203 basedon the reference position on the general map, an end point 202 of thedynamic wall 203 is positioned at the reference position.

Accordingly, a moving distance D is determined by obtaining 1.5 lanes bydividing 6 lanes by 4 and multiplying 1.5 by the lane width, and adynamic wall 204 is positioned at a center line 205 of a driving lane.The dynamic wall 203 moves as much as D, which is the distance from theroad center line 201 to the center line 205 of the driving lane, andfinally the dynamic wall 204 is positioned at the center line 205 of thedriving lane.

Furthermore, the processor 130 may determine a moving direction of thereference position in consideration of a vehicle driving direction foreach country. The processor 130 may determine a moving direction as adirection of a lane in which a host vehicle is traveling based on a roadlink. For example, when the road link is based on right traffic, thereference position may be moved in a right direction thereof, and whenthe road link is based on left traffic, the reference position may bemoved in a left direction thereof.

The processor 130 may determine the position of the display object usingguidance information for each lane on the map in an environment where aprecise map is not provided or precise positioning is not available.

For example, in the case where the total number of lanes currentlydriving is four lanes one-way including a left turn lane, a firststraight lane, a second straight lane, and a right turn lane, when thedriving direction of the host vehicle is a forward direction thereof,the position of the display object may be determined by moving thereference position on the map by as many as two lanes corresponding tothe forward direction among all four lanes. That is, the position of thedisplay object is a reference position on the general map, and thereference position on the general map is inaccurate and is located at acenter line and not a precise lane, and when a current traveling path ofthe host vehicle is to turn left, the host vehicle may be positioned inthe left turn lane, and thus the position of the display object may beselected by moving from the reference position to the right by one lane.

Furthermore, when the display object is displayed based on augmentedreality, the processor 130 may display the display object only within alane of the same driving direction as the driving direction of the hostvehicle. That is, the processor 130 does not display the display objecton a driving lane in the opposite direction thereof.

For example, when expressing an animal object such as a group moving, acorresponding animal object may be represented within a lane having thesame driving direction as the driving direction of the host vehicle. Forexample, a dolphin swims in the same direction as the host vehicle, andswims in a lane next thereto, which is running in the same directionthereof, but is not displayed in a lane in the opposite direction beyondthe center line, and thus the display object may be displayed only inthe lanes in the driving direction of the host vehicle.

The processor 130 may estimate a width of another lane by use of a lanewidth of a lane on which the host vehicle is currently traveling. Thatis, when moving the reference position on the map, the processor 130 mayestimate a distance (moving distance) to which the reference positionshould be moved based on a number of lanes, by use of a width of thecurrent driving lane or a width of a measurable lane.

When a width of several lanes may be measured at a same time, theprocessor 130 may perform the estimation by excluding or including acase where there is a specific value (e.g., too narrow or wide) amongthem. For example, when only the width of the current driving lane maybe measured, it may be estimated that the width of the current drivinglane and a width of another lane are the same. Furthermore, as anexample, when three lanes based on the host vehicle may be measured, theprocessor 130 may estimate a width of another lane by use of the averagevalue of all lanes (three lanes).

Furthermore, as an example, the processor 130 measures widths of threelanes based on the own vehicle, but when one lane is too narrow, anaverage value of the two lanes may be determined to estimate widths ofthe other lanes. However, when the host vehicle is unable to estimatethe width of the driving lane, the processor 130 may determine a movingdistance for moving the reference position by determining the lane widthas a predetermined value (e.g., 2.7 m), and using the number of lanesand the predetermined lane width.

The processor 130 may display ECO information based on augmentedreality.

That is, the processor 130 may differently express a color, size, shape,etc. of the display object depending on a change in an eco state of thevehicle based on augmented reality. For example, it is possible todisplay the eco state by dividing it by colors of a carpet.

FIG. 3A, FIG. 3B and FIG. 3C illustrate an example of differentlydisplaying a color of a carpet depending on a vehicle state based onaugmented reality according to various exemplary embodiments of thepresent invention. FIG. 4 illustrates an example of displaying a colorof a carpet in a stepwise manner depending on a vehicle state based onaugmented reality according to various exemplary embodiments of thepresent invention.

As an example in which colors for each state are classified anddisplayed, FIG. 3A illustrates a color of a carpet 301 when theeco-state of the vehicle is “High,” FIG. 3B illustrates a color of acarpet 302 when the eco state is “Medium,” and FIG. 3C illustrates acolor of a carpet 303 when the eco state is “Low.”

In FIG. 4 , as an example in which colors are classified and displayedin the carpet step by step depending on the eco state, even when the ecostate is “High,” the carpet is not displayed in one green colordepending on a degree thereof, and a green color 401 and a blue color402 may be used to indicate the color of the carpet. For example, in thecase where the eco state is 80 or higher, the carpet may be displayed inblue when the eco status is “90”, the carpet may be displayed in greenand blue colors together when the eco state is 85, and the carpet may bedisplayed in green when the eco state is 80, so that the eco state maybe further subdivided and displayed.

Although not illustrated, when the eco state is “Medium,” the color ofthe carpet may be displayed in combination with green and orange, andwhen the eco state is “Low,” the color of the carpet may be displayed incombination with orange and red.

Furthermore, the processor 130 may display an economical state (ECOstate) by use of an animal or plant based on augmented reality. Forexample, when the eco-state of the vehicle is “High”, an animation of adolphin swimming in the same direction as the driving direction may beapplied, when the eco state is “Medium”, an animation of a rabbitrunning may be applied, and when the eco state is “Low,” an animate of aturtle crawling may be applied.

The processor 130 may determine an eco state depending on currentaverage fuel efficiency or instantaneous fuel efficiency of the hostvehicle to display eco information.

That is, the processor 130 may determine a current driving state as theeconomical mode (i.e., eco mode) when the average or instantaneous fuelefficiency of the host vehicle exceeds official fuel efficiency of thecorresponding vehicle.

Furthermore, the processor 130 may determine the eco state of the hostvehicle through fuel efficiency comparison with another vehicle todisplay the eco information. That is, the processor 130 may determinewhether or not the vehicle is in the eco state through the fuelefficiency comparison with another vehicle based on a same vehicle typeor a same option. In the instant case, the another vehicle may includeat least one of all vehicles within a certain radius or satisfying acertain condition (e.g., all vehicles driving on the road which is thehost vehicle is currently driving), all vehicles in a same country basedon a same vehicle type, and vehicles designated with consent of a user.

In an exemplary embodiment of the present invention, the certain radiusis a predetermined radius from the host vehicle.

For example, when a current vehicle model is K7, the eco state may bedetermined by comparing average fuel efficiency of all K7 models in usewith average fuel efficiency of the host vehicle. In the instant case,the instantaneous fuel efficiency may be used instead of the averagefuel efficiency.

For example, when a current vehicle model has 8-speed automatictransmission 3.0 of K7, fuel efficiency of a current vehicle may becompared with fuel efficiency based on a vehicle model option.

The processor 130 may determine the eco state depending on a batteryusage state to display eco information. In the instant case, the batteryuse state may be classified into a normal mode (normal, no battery use,e.g., driving of an internal combustion engine), a using mode (using,battery use), and a charging mode (charging, battery charging).

The processor 130 may differentiate and display colors and sizes ofdisplay objects (e.g., carpets, battery-shaped objects, etc.) for eachstate in the augmented reality according to the battery usage state ofthe vehicle.

Accordingly, as the processor 130 expresses eco information in augmentedreality, it is easy for a user to recognize a current driving state, andin some cases, a separate animation is applied to increase an aestheticeffect to induce a user's desire to improve vehicle fuel efficiency,improving vehicle fuel efficiency.

In an existing navigation system, it is difficult to provide the userwith a sense of reality by displaying boundaries of regions on mapinformation in a limited manner, and thus the processor 130 in variousexemplary embodiments of the present invention may display regionalboundary information based on augmented reality so that the user canmore easily recognize a change in a driving environment when passingthrough the boundaries of the regions.

The processor 130 may display regional boundary information based on theaugmented reality.

The processor 130 displays map information using augmented reality andpositions information related to the host vehicle. The processor 130 mayuse regional information and regional boundary information provided bythe map, but when there is a separate recognition device andrecognizable information, it may clarify regional boundaryclassification using them.

When a national boundary is moved, the processor 130 may display thenational boundary based on augmented reality by use of at least one of aflag of a corresponding region representing an administrative unit suchas a country, a region name, and a symbol that can symbolize the region.For example, a symbol that can symbolize a region include acomprehensive concept that symbolizes the region, and in the case of acountry, it includes a coat of arms, a crest, a national flag, a countryname, and a national bird and a national flower of each country, and theborder may be displayed based on augmented reality. FIG. 5A illustratesan example of displaying a flag 501 of a country to be entered later,and FIG. 5B illustrates an example of displaying a flag 502 of a currentcountry before crossing a border.

Furthermore, the processor 130 may display regional boundaries based onaugmented reality by use of at least one of symbols, region names, andbywords that can symbolize a corresponding region to separate regionsother than administrative units. For example, in the case of a hazardousarea, a name of the hazardous area may be used, or a commonly used namemay be indicated.

Furthermore, the processor 130 may display any one or more ofinformation related to an area where it is currently positioned orinformation related to a new area which it newly enters as informationon the regional boundaries. For example, a flag of a current country isdisplayed before passing through a national border thereof, and a flagof a corresponding country is displayed after passing through a nationalborder thereof.

FIG. 5C illustrates an example in which a flag 503 of a current countryis displayed and a flag 504 of a country that it enters later isdisplayed when a country border thereof is moved according to variousexemplary embodiments of the present invention.

Accordingly, if necessary, the processor 130 displays informationrelated to a corresponding area from in front thereof with apredetermined distance before passing through a regional boundary, ordisplays the information related to the area within a predetermineddistance after passing through the area boundary. For example, flaginformation related to the country may be displayed at 100 m intervalsfrom 500 m before passing the national border, and the national flag maybe displayed at 100 m intervals up to 500 m after passing the nationalborder.

Accordingly, the processor 130 displays a boundary of a region inaugmented reality so that a user can easily recognize a change in adriving environment when passing the boundary of the region.

When the augmented reality is applied, the processor 130 may changeexpression concept depending on a setting for each function. When adisplay object is expressed in the augmented reality, at least onemethod or function for expressing the corresponding object is providedso that a user can select and apply one of at least one method orfunction. In the instant case, a target to be selected may be an entireor portion of a function provided as augmented reality.

For example, the processor 130 may provide a setting for carpet displayprovided as augmented reality in three-ways, and when a setting otherthan the default setting is applied, may receive a change in a color orshape, etc. of a carpet from a user, to display the carpet in adifferent manner.

The processor 130 may determine whether to display each function in theaugmented reality function depending on the setting. That is, since theprocessor 130 may provide a function to turn on/off some of variousfunctions provided by augmented reality. However, some functions may beprovided by default, so on/off functions are not provided.

As an example, the processor 130 may turn on or off a lane departurewarning provided as augmented reality for safety in the setting, but thecarpet display does not provide the on/off function.

Accordingly, user convenience may be increased by providing a user withan authority to select whether to display each function in the augmentedreality function.

The display device 140 is controlled by the processor 130 to displayvehicle information based on augmented reality. As an example, thedisplay device 140 may display a vehicle state (eco information andbattery state), and region (or country) boundary information based onaugmented reality during movement. Furthermore, the display device 140may display a screen for changing a setting for each function whenaugmented reality is applied. Furthermore, the display device 140 maydisplay a display object depending on a position and a driving directionof the display object determined by the processor 130 based on augmentedreality.

As an example, the display device 140 may be implemented as a head-updisplay (HUD), a cluster, an audio video navigation (AVN), or a humanmachine interface (HMI). Furthermore, the display device 140 may includeat least one of a liquid crystal display (LCD), a thin film transistorliquid crystal display (TFT LCD or thin film transistor-LCD), a lightemitting diode (LED) display, an organic light emitting diode (OLED ororganic LED) display, an active OLED (AMOLED or active matrix OLED)display, a flexible display, a bended display, and a 3D display. Some ofthese displays may be implemented as a transparent display formed of atransparent or translucent type such that the outside may be viewed.Furthermore, the display device 140 may be provided as a touch screenincluding a touch panel, and may be used as an input device as well asan output device.

Accordingly, according to various exemplary embodiments of the presentinvention, user recognition may be improved and a sense of heterogeneitymay be minimized by accurately selecting a position and displaying fuelefficiency state, driving-related information, regional boundaryinformation, etc., based on augmented reality.

Furthermore, according to various exemplary embodiments of the presentinvention, user convenience may be improved by supplementing possibilityof errors in information which is matched with the real world based onaugmented reality and displaying information related to areas that couldnot be displayed based on augmented reality.

The above description is merely illustrative of the technical idea ofthe present invention, and those skilled in the art to which variousexemplary embodiments of the present invention pertains may make variousmodifications and variations without departing from the essentialcharacteristics of the present invention.

For convenience in explanation and accurate definition in the appendedclaims, the terms “upper”, “lower”, “inner”, “outer”, “up”, “down”,“upwards”, “downwards”, “front”, “rear”, “back”, “inside”, “outside”,“inwardly”, “outwardly”, “interior”, “exterior”, “internal”, “external”,“forwards”, and “backwards” are used to describe features of theexemplary embodiments with reference to the positions of such featuresas displayed in the figures. It will be further understood that the term“connect” or its derivatives refer both to direct and indirectconnection.

The foregoing descriptions of specific exemplary embodiments of thepresent invention have been presented for purposes of illustration anddescription. They are not intended to be exhaustive or to limit thepresent invention to the precise forms disclosed, and obviously manymodifications and variations are possible in light of the aboveteachings. The exemplary embodiments were chosen and described toexplain certain principles of the present invention and their practicalapplication, to enable others skilled in the art to make and utilizevarious exemplary embodiments of the present invention, as well asvarious alternatives and modifications thereof. It is intended that thescope of the present invention be defined by the Claims appended heretoand their equivalents.

What is claimed is:
 1. An information display device comprising: aprocessor configured to display a display object in augmented reality;and a storage configured to store data and algorithms driven by theprocessor, wherein the processor is configured to determine a positionof the display object by use of at least one of a total number of lanesor a number of lanes in a road in a driving direction of a host vehicle,possible traveling direction information for each lane, and drivingdirection information related to the host vehicle, and wherein theinformation display apparatus is disposed within the host vehicle oroutside the host vehicle, and when disposed outside the host vehicle, isconfigured to transmit display information related to the display objectto the host vehicle or a mobile device, wherein the processor isconfigured to determine a moving distance according to the total numberof lanes in a case of a road, in which there is no distinction betweendirections of going up and down on a map, and wherein the processor isconfigured to determine the moving distance by use of at least one ofthe total number of lanes in the driving direction, the number of lanesin the driving direction, and a number of lanes in a direction oppositeto the driving direction, and is configured to determine the position ofthe display object by moving a reference position on the map by themoving distance in a case of the road in which there is the distinctionbetween the directions of going up and down on the map.
 2. Theinformation display device of claim 1, wherein the processor isconfigured to determine the position of the display object by moving areference position on a map from a lane on which the host vehicle istraveling to a lane corresponding to the driving direction of the hostvehicle by use of the possible traveling direction information for eachlane.
 3. The information display device of claim 1, wherein theprocessor is configured to display the display object in a lane having asame driving direction as the driving direction of the host vehicle, anddoes not display the display object in a lane having a directionopposite to the driving direction of the host vehicle.
 4. Theinformation display device of claim 1, wherein the processor isconfigured to determine the moving distance according to the totalnumber of lanes and lane widths in the case of the road in which thereis no distinction between directions of going up and down on the map,and wherein the processor is configured to determine the moving distanceby use of the lane widths and at least one of the total number of lanesin the driving direction, the number of lanes in the driving direction,and the number of lanes in the direction opposite to the drivingdirection, and is configured to determine the position of the displayobject by moving the reference position on the map by the movingdistance in the case of the road in which there is the distinctionbetween the directions of going up and down on the map.
 5. Theinformation display device of claim 2, wherein the processor isconfigured to determine a moving direction of the reference position inconsideration of the host vehicle driving direction for each country. 6.The information display device of claim 4, wherein the processor isconfigured to estimate a width of another lane by use of a lane width ofa lane on which the host vehicle is currently traveling, or to determinewidths of at least one lane in the driving direction of the host vehicleon the road on which the host vehicle is traveling, and then to estimatean average value of the determined widths of the at least one lane aseach lane width.
 7. The information display device of claim 4, whereinthe processor is configured to determine the moving distance of thereference position by determining a lane width as a predetermined valueand using the number of lanes and the lane widths when unable toestimate a lane width of a lane on which the host vehicle is traveling.8. The information display device of claim 6, wherein the processor isconfigured to determine the average value of the lane width by use ofremaining lane widths excluding a lane width which is outside apredetermined reference range when a determined value of each lane isoutside the predetermined reference range after determining the widthsof the at least one lane.